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Abstract 


The synergy between Big Data and Open Data has the 
potential to revolutionize information access in the devel- 
oping world. Following this mantra, we present the anal- 
ysis of more than a decade worth of open judgements and 
orders from the Supreme Court of Pakistan. Our overar- 
ching goal is to discern the presence of judicial activism 
in the country in the wake of the Lawyers’ Movement. 
Using Apache Spark as the processing engine we ana- 
lyze hundreds of unstructured PDF documents to sketch 
the evolution and various organs of judicial activism in 
Pakistan since 2009. Our results show that the judiciary 
has indeed been pursuing matters of public interest, espe- 
cially those that pertain to the fundamental rights of the 
citizens. Furthermore, we show how the size of the pre- 
siding bench in a case and citations of Articles from the 
Constitution and prior judgements can aid in classifying 
legal judgements. Throughout the analysis we also high- 
light the challenges that anyone who aims to apply Big 
Data techniques to Open Data will face. We hope that 
this work will be one in a series of community efforts to 
use Open Data as a lens to analyze real-world events and 
phenomena in the developing world. 


1 Introduction 


Big Data analysis has been a boon to a large number of 
scientific domains, ranging from genome sequencing and 
particle physics to transportation management 
and urban planning [24]. Originally spawned by web 2.0 
companies, such as social networks, e-commerce sites, 
and search engines, to cater to their business needs, Big 
Data has now pervaded almost every academic, scien- 
tific, and business field. This “Big Data Spring” has 
been aided by an entire ecosystem of largely open source 
tools, including processing frameworks [7] BI], storage 
solutions [18] [29], and analytical tools (22) [14]. A large 


number of recent initiatives D] have made use of 


Big Data analytics to tackle problems in the developing 
world. While these endeavours are indeed promising, the 
lack of open data, human and technical capacity, and fi- 
nances in the developing world has incapacitated it from 
truly riding the Big Data wave [5] [23}. 


The primary problem is the lack of data in the first 
place. In most of the developing world, census data for 
instance is manually collected via surveys, which are 
rarely digitized [28]. Furthermore, even if the data is 
collected and digitized, it is locked away behind mul- 
tiple levels of bureaucratic red tape. Similarly, private 
sector entities, such as telcos have a rich set of data, 
even in these regions but privacy and unclear data shar- 
ing incentives have hampered their “data philanthropy” 
efforts [5]. Finally, if the data is available, the lack of 
analytics and systems skills in the local workforce and 
almost non-existent data management policy at the state 
level, hinders any useful analysis. The problem is exacer- 
bated by traditional technology-centric developing world 
problems, such as low Internet penetration and intermit- 
tent power, which fortify the digital divide in data repre- 
sentation [23]. 

In the last few years, aided by technology, a number 
of developing world countries have experienced popu- 
lar uprisings centered around the devolution of power. 
In certain cases, the judiciary has also played an active 
role in the quest to counter and even depose decades 
old authoritarian regimes and political structures. For in- 
stance, even as early as 2006, before the “Arab Spring”, 
the judiciary in Egypt started questioning the status quo. 
Dubbed the Judicial Intifada, members of the Judges 
Club clashed with the government of Hosni Mubarak 
for the independence and reform of the judiciary [II]. 
Similarly, the 2007 Lawyers’ Movement in Pakistan also 
aimed to establish the independence of the judiciary in 
a country where the courts have traditionally towed the 
line of the government. In the wake of the movement, the 
superior judiciary started confronting the government of 
the time in matters of public interest. Similar instances 
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of judicial activism or public interest litigation are appli- 
cable to India, Malaysia, and Turkey, among many oth- 
ers [16]. 

The legal field in general has also embraced Big Data 
by making use of it to, for instance, predict the outcome 
of cases and motions, and determine litigation fees [B]. 
Some experts have gone to the extent of calling predic- 
tive Big Data analytics the “potential holy grail in the 
practice of law” [20]. Unfortunately, so far only private 
firms have been able to leverage these solutions whereas 
widespread public sector usage has been found wanting 
due to the lack of open data and tools. This has resulted 
in public practitioners and society at large becoming le- 
gal Big Data “poor” [4]. More concretely, the lack of a 
“Legal Big Data Toolkit” to incorporate legal complexi- 
ties, jargon, and nuance is a major challenge [26]. 

In this paper, we tackle this dual Big Data “poverty’— 
in the developing world and the legal domain—by an- 
alyzing legal judgements from the Supreme Court of 
Pakistan—the apex court of the country—which span more 
than a decade of open data. In the process, we high- 
light (1) the challenges faced in analyzing unstructured 
and noisy PDF documents, (2) the use of open source 
Big Data tools for developing world problems, and (3) 
the need to possess domain specific knowledge, for in- 
stance to interpret legal jargon, while undertaking such 
an analysis. While only a preliminary study, our results 
show that even limited open data can reveal a wide range 
of interesting trends and figures. Specifically, our anal- 
ysis shows that the number of Suo Moto cases—wherein 
the court decides to take up a case of its own accord— 
increased after a popular judicial revival in the country. 
In addition, the bulk of the judgements pertain to consti- 
tutional, civil, and human rights cases, indicating a tilt to- 
wards public interest issues. The same trend is reflected 
by the Articles of the Constitution and previous judge- 
ments frequently referred to in the judgements. Finally, 
we also report trends in the bench distribution, jurisdic- 
tion, judgements per year, prolific judges, and others. 

The rest of the paper is organized as follows. In the 
next section B}. we give a brief introduction to the ju- 
dicial system in Pakistan. In addition, we provide an 
overview of Apache Spark [31], the data processing plat- 
form we employed for our analysis. The methodology 
of the study is presented in {4] unveils the analysis 
of the metadata from the documents. These results are 
augmented by the in-depth analysis of the actual content 
in {6|concludes the paper and outlines future work. 


2 Background 


In the section, we give a high-level overview of the le- 
gal system in Pakistan (821). We follow this up with an 
introduction to Apache Spark, an all-encompassing Big 


Data processing platform (2.2). 


2.1 Judicial System of Pakistan 


The Judicial System of Pakistan is divided into the Su- 
perior Judiciary, Subordinate Courts, and Special Courts 
and Tribunals [13]. As this paper analyzes judgements 
from the Supreme Court, we discuss its set up in detail 
while glossing over the details of the Subordinate Courts, 
and Special Courts and Tribunals. The Superior Judi- 
ciary consists of the Supreme Court, 5 High Courts (one 
for each of the 4 provinces and the Federal District), and 
the Federal Shariat Court. This set up is comprehensively 
laid out and enshrined in the Constitution of Pakistan 
which also enunciates the “separation of judiciary from 
the executive” and the “independence of judiciary” [13]. 
The Superior Judiciary also enjoys financial autonomy 
from the Executive and the Legislative branches of gov- 
ernment, allowing it to act independently. Appointments 
to the Superior Judiciary are handled by an independent 
Judicial Commission—comprising senior judges and rep- 
resentatives from the bar and government—which makes 
recommendations which are then confirmed by the Leg- 
islature. Similarly, accountability is enforced through a 
Supreme Judicial Council which is made up of senior 
judges from the Superior Judiciary. 

The Supreme Court, which is the apex court of the 
country, has original, appellate, and advisory jurisdic- 
tion. It has original jurisdiction in inter-governmental 
disputes and fundamental rights issues, appellate juris- 
diction in civil and criminal issues, and advisory juris- 
diction in legal and constitutional advice to the Govern- 
ment. Its decisions and interpretations are final and bind- 
ing on all other courts. The Superior Court comprises a 
Chief Justice and a bench of 16 judges. Similar struc- 
ture, with some differences, applies to the various High 
Courts. The Federal Shariat Court on the other hand, 
only has jurisdiction to decide “whether or not a certain 
provision of law is repugnant to the injunctions of Is- 
lam” [13]. The Subordinate Courts deal with civil and 
criminal matters. Finally, a number of Special Courts 
and Tribunals, such as Banking Courts, Income Tax Ap- 
pellate Tribunal, and Anti-Terrorism Courts have juris- 
diction over domain specific issues and matters. 

The Constitution of Pakistan has elements from 
British Law-largely through the Government of India 
Act 1935-and Islamic Law [15]. Post-Independence in 
1947, the Government of India Act 1935 was amended 
and Islamic Provisions were incorporated over a period 
of many decades to result in the 1973 Constitution. This 
Constitution has undergone 20 Amendments since then 
to reach its current state. It consists of 280 Articles, di- 
vided into Sections, which collectively enshrine the setup 
and structure of the state and system, and the rights of the 
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citizend!| 

Over the course of its turbulent history, Pakistan has 
oscillated between democratic and military rule. Dur- 
ing every military rule, the judiciary has been accused of 
not only turning a blind eye to the military regime but 
even providing legal cover to it under the “Doctrine of 
State Necessity” [17]. All of this dramatically changed 
in 2007, when the Chief Justice of the Supreme Court, 
Iftikhar Muhammad Chaudhry, refused to resign on the 
orders of the then President, General Pervez Mushar- 
raf. Without getting into the specific details of the in- 
cident and its aftermath, it will suffice to say that the 
subsequent sacking of the Superior Judiciary, spawned 
a popular movement, led by lawyers and students, which 
culminated in the restoration of all judges including the 
Chief Justice in 2009 [T]. Cognizant of their public man- 
date, the bench started pursuing issues of public inter- 
est through Suo Moto cases. Again, without getting into 
the discussion of the pros and cons of this judicial ac- 
tivism [10], in this paper, we use the judgements from the 
last one decade as a lens to illuminate its various facets. 
Therefore, the goal of this paper is neither to argue for 
a stance on judicial activism nor to question its ramifica- 
tions or to take a position in any of the events. 


2.2 Apache Spark 


Apache Spark is an open source data processing plat- 
form, originally spawned at UC Berkeley [BI], which 
incorporates multiple processing paradigms, including 
batch, iterative, and streaming analysis. Like its prede- 
cessor, Hadoop] it masks away the intricacies of dis- 
tributed computation, such as work distribution, schedul- 
ing, data transfer, and fault-tolerance, beneath a simple 
API. In essence, the application developer only focuses 
on the business logic of the application, while the un- 
derlying platform performs all the heavy lifting. Un- 
like Hadoop, which has a strict two-stage API (map and 
then reduce, with a transparent group by in the middle), 
Spark applications can have multiple stages, thus form- 
ing a directed graph of computation. At the very core of 
Spark, lies the concept of Resilient Distributed Datasets 
(RDDs), which are datasets with customizable persis- 
tence, fault-tolerance, and availability guarantees. RDDs 
can be cached in memory (with selective compression 
and serialization) or backed by flat files on a distributed 
filesystem (Hadoop Distributed Filesystem (HDFS) 
by default). Each RDD also stores its lineage graph, al- 
lowing it to be regenerated if it is lost. This ability to 
process data in memory allows Spark, in some cases, to 
achieve an order of magnitude better performance than 
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www.pakistani.org/pakistan/constitution/ 
“Apache Hadoop —|http: //hadoop. apache. org/ 





Hadoop [31]. 

A Spark application starts by converting a dataset, typ- 
ically read from the HDFS, to an RDD. A functional API 
is then used to perform transformations on this dataset, 
where each transformation results in a new RDD which 
is ingested by a subsequent stage. Each transformation 
(or the application of a function) is parallelized across 
multiple cores and machines. The computation is ex- 
hausted when a “side-effect”, writing to a file or print- 
ing to standard output for instance, is introduced into the 
computation graph. The core of Spark is implemented 
in Scala [21], a functional programming language. Scala 
is also the language of choice for implementing Spark 
applications, although it has bindings for other popu- 
lar languages, such as Java and Python. In the last few 
years, the core Spark project has evolved to add stream 
processing [32], declarative processing and storage [30], 
and a suite of machine learning] and graph processing] 
libraries, to its standard arsenal. 


3 Methodology 


In this section, we discuss the methodology we adopted 
for our analysis including data collection, curation, and 
examination. 

Since 2001, the Supreme Court of Pakistan has been 
hosting some of its judgements and orders on its web- 
sit] These documents are available in the form of un- 
structured PDFs often augmented with a small amount 
of metadata. The metadata consists of the title of the 
judgement/order, its public release date, and a brief de- 
scription. We followed a five step analysis: (1) website 
crawl, (2) metadata analysis, (3) document download, (4) 
conversion from PDF to HTML, and (5) analysis of the 
content of the HMTL documents. In the following, we 
briefly discuss each step. 


3.1 Website Crawl 


All of the judgements and orders are linked from a single 
page. This page contains the metadata for each document 
as well as a link to a separate download page for each. 
We scraped the HTML from this page using a custom 
Scala script to generate a CSV file with four columns: (1) 
Download page link, (2) title, (3) date, and (4) descrip- 
tion (if available). In total we were able to get metadata 
for 415 documents, starting from April 2001 and ending 
in August 2014. 


3 Spark MLlib — https: //spark.apache.org/mllib/ 
4Spark GraphX — https: //spark.apache.org/graphx/ 
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Figure 1: Processing Pipeline 


3.2 Metadata Analysis 


A Spark application was used to analyze this CSV to cal- 
culate the number of cases per year, the distribution of 
Suo Moto cases, and the type of each judgement/order 
(constitution, civil, criminal, etc.) 


3.3 Document Download 


We then wrote another Spark job to download each PDF 
and store it locally. 12 out of the 415 links were dead, 
reducing the number of downloaded PDFs to 403. 


3.4 Conversion of PDF to HTML 


Apache PDFBox)| was employed for the PDF to HTML 
conversion. A Spark job was applied to convert the 403 
PDFs to HTML and then store them locally again. Out of 
these, 25 documents could not be converted as they were 
in Urdu-the national language of Pakistan. In addition, 
the conversion for another 7 PDFs failed due to bad qual- 
ity of their PDF images. Therefore, a total of 371 HTML 
documents were obtained. 


3.5 Content Analysis 


A Document Object Model’ for each HTML document 
was generated and used in conjunction with a series 
of regular expressions to extract relevant information 
through a series of Spark jobs. Using this procedure, the 
jurisdiction of each case, the distribution of the panel for 
each case, and the Articles of the Constitution and previ- 
ous judgements/orders referred to in each document were 
computed. 


3.6 Discussion 


We initially implemented each of these stages separately 
and used Spark for exploratory and interactive analysis 
of the data. Once we had all the building blocks in place, 


6 Apache PDFBox — https: //pdfbox.apache.org/ 
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we connected them together to engender an automated 
processing pipeline (depicted in Figure[i}. Therefore, the 
same application can be used in an automated fashion to 
analyze other similar datasets. 


At this point, it is necessary to highlight that 403 PDF 
documents can by no means be labelled as “Big Data” 
and the use of a data intensive computing platform, such 
as Spark might be overkill [25]. But the general tech- 
niques and tools used in our analysis can be used to an- 
alyze a larger number of such documents. For instance, 
each of the 5 High Courts also has its judgements/orders 
on its website. Collectively, this dataset comprises thou- 
sands of documents. In addition, the same analysis can 
be extended to India, which has a similar judicial sys- 
tem. In case of India, judgements for both the Supreme 
Court as well as dozens of its High Courts since 1950 are 
available as open data, potentially resulting in a dataset 
with millions of such documents* Although in this pa- 
per, we confine ourselves to the said 403 documents, we 
hope that our thesis, proposed practices, and lessons will 
serve as a blueprint for others to undertake similar anal- 
ysis. Along with the legal field, these techniques can be 
augmented to analyze open data in the developing world 
from a wider range of domains, including agriculture, en- 
ergy, education, and health-care. Such studies will be ex- 
tremely useful in illustrating various trends and statistics 
which can be put to the test in the real-world to improve 
some of the shortcomings in these domains. Open data is 
extremely promising, but unless it is made consumable, 
itis meaningless. 


A similar argument applies to the usage of Spark. We 
could easily have written a standalone Scala applica- 
tion to perform the analysis. We opted for a standard 
distributed processing platform to underscore how such 
platforms can simplify application development and po- 
tentially crunch a similar but substantially larger dataset. 





8The Judgments Information System of India —/http://judis. 
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Figure 2: Distribution of cases by year. 


4 Metadata Analysis 


This section presents the outcome of our metadata anal- 
ysis. 


4.1 Distribution of cases by year 


As mentioned before, the metadata also contains a pub- 
lic release date for the judgements. While this date was 
present in most instances, it was found to be missing in a 
few. We manually filled in the missing values by cross- 
referencing them with other online sources. This leads to 
the first lesson that we learnt: LI — Expect missing values 
in open data. Figure 22|plots the distribution of cases by 
year. We see a sharp increase from 2009 onwards in the 
number of judgements/orders passed annually. This co- 
incides with the restoration of the judges in 2009. Due to 
its wide jurisdiction, the Supreme Court of Pakistan has 
traditionally had to deal with more cases than its capac- 
ity. It annually receives more than 15000 petitions and 
appeals, and more than 30000 applications [13]. Most 
of these are routed to provincial benches of the Court 
to ensure fast response. Only important cases are dealt 
with by the Principal Bench—whose judgements consti- 
tute our dataset. Therefore, the increase in the number 
of judgements/orders post-restoration in 2009, indicates 
the inclination of the Supreme Court to take up more 
cases in the wider public interest as a form of judicial 
activism. It may also be indicative of the effectiveness of 
the National Judicial Policy enacted in 2009 to expedite 
and streamline the Superior Judicial Process [13]. 

One way to discern judicial activism is by analyzing 
the number of Suo Moto cases undertaken by the Court. 
Under Article 184 (3) of the Constitution, the Supreme 
Court has the power to take up cases of its own accord 
which violate the fundamental rights of the people as 
enunciated in the Constitution. Typically, these are un- 
dertaken after a story appears in the print and/or elec- 
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Figure 3: Distribution of Suo Moto cases by year. 














S# | Type # of Cases 
l. Constitution 173 
2. Civil Miscellaneous Application 99 
3. Suo Moto Case 62 
4. Human Rights Case 48 
5. | Civil 41 
6. | Civil Appeal 39 
T: Civil Review 16 
8. Criminal 12 
9. Criminal Appeal 11 
10. | Criminal Miscellaneous Application | 9 
11. | Reference 6 
12. | Unknown 3 
13. | Jail Petition 2 
14. | Civil Petition for Leave to Appeal 1 











Table 1: Distribution of cases by type. 


tronic media or a citizen directly writes to the Court [6]. 
Ordinarily it is the job of the State through its policing 
system to ensure the fundamental rights of its citizens. 
But if it is ineffective in doing so, the void can be filled 
by the judiciary to play a more active role in the resolu- 
tion of such issues. Figure [3| segments the distribution 
of Suo Moto cases by year. In line with Figure |2} the 
number of Suo Moto cases also follows a similar trend, 
which suggests the presence of judicial activism. In ad- 
dition, Suo Moto cases accounted for 8.1% of the total 
cases pre-2009. Post-2009, once the deposed bench was 
reinstated, that number increased to 15.6%, indicating a 
clear tendency of the court to exercise Article 184 (3). 


4.2 Distribution of cases by type 


The title of each case in the metadata also contains its 
type in many instances. In total we were able to glean 
13 different types. It is noteworthy that (a) a case might 
be made up of more than one type; for instance a case 
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S# | Jurisdiction # of Cases 
1. | Original 230 

2. | Appellate 103 

3. | Review 18 

4. | Original/Appellate | 9 

5. | Advisory 5 

6. | Original/Review 4 

7. | Contempt 1 

8. | Unknown 1 

















Table 2: Distribution of cases by jurisdiction. 


might be both a Civil Miscellaneous Application as well 
as a Constitution Petition, and (b) the title only contains 
the abbreviations of a few of these types from within a 
case. For instance, we noticed 12 different descriptions 
for Constitution Petition, including a number of misspelt 
variants. In addition, there is inconsistency in the syn- 
tax used to describe a case. Furthermore, some of the 
types were abbreviated. In some instances, it was easy 
to expand these abbreviations. For example, Const. Pe- 
tition is clearly the abbreviated form of Constitution Pe- 
tition. Consider another example, c.p. which may map 
to Civil Petition, Constitution Petition, or Criminal Peti- 
tion. To ensure that all variants were accounted for, we 
constructed a look-up table for this resolution by consult- 
ing various online sources, including the Supreme Court 
website itself. This exercise resulted in three lessons: 
L2 — There will be term inconsistency in open data, 
L3 — Terms will often be misspelt, and L4 — Domain 
knowledge-legal jargon in this case—is priceless in even 
basic analysis. All in all, metadata is not enough or is 
an inaccurate measure to gauge all of the different types 
that constitute the judgements/orders. Nonetheless, it 
provides an initial window into the distribution of these 
different types. These are presented in Table[I] Constitu- 
tion Petitions, for which the Court has original jurisdic- 
tion, make up around 1/3rd of all judgements/orders. In 
addition, Suo Moto and Human Rights cases also have 
a sizable presence, mostly at the discretion of the Court, 
indicating its interest in pursuing issues concerning fun- 
damental rights. 


5 In-depth Analysis 


To perform an in-depth analysis of the actual content 
of the documents, we first converted them from PDF 
to HTML. As noted earlier, out of total 403, 371 were 
successfully converted to HTML. 32 documents were 
skipped primarily because they were in Urdu, even 
though this was not mentioned in the metadata: L5 
— Open data contains incomplete and even misleading 
metadata information. 








S# | Name # of Cases 
l. Justice Iftikhar Muhammad Chaudhry | 232 
2. | Justice Jawwad S. Khawaja 125 
3. | Justice Khilji Arif Hussain 95 
4. Justice Gulzar Ahmed 75 
5. | Justice Tassaduq Hussain Jillani 74 
6. Justice Sh. Azmat Saeed 71 
Ta Justice Ijaz Ahmed Chaudhry 51 
8. | Justice Hani Muslim 50 
9. | Justice Tariq Parvez 50 
10. | Justice Anwar Zaheer Jamali 45 

















Table 3: List of the ten most prolific judges. 


5.1 Distribution by jurisdiction 


Each judgement/order also contains the jurisdiction of 
the case. This information is useful in analyzing the dif- 
ferent number of cases for which the Court had direct 
jurisdiction, i.e. constitutional and fundamental rights 
issues, or indirect jurisdiction, in case of civil and crim- 
inal matters. The distribution of cases by jurisdiction 
gleaned from the content of the documents is shown in 
Table This presents another view of the data in Ta- 
ble The number of cases for which the court has 
original jurisdiction—constitution, Suo Moto, and human 
rights—make up the bulk of the judgements similar to the 
distribution by type. 


5.2 Most prolific judges 


We next analyze the distribution of the make up of the 
bench for each case. The PDF documents also contain 
this information. The DOM for each HTML document 
was not sufficient for extracting this information due to 
its extreme, unstructured nature: L6 — Open data can 
potentially be unstructured and hard to parse. There- 
fore, we had to augment the DOM with a series of reg- 
ular expressions to extract the names of the presiding 
judges from the preamble of each document. We could 
only extract these names from 364 out of the 371 doc- 
uments; they were missing from 2 documents, while 5 
documents had extremely dirty, noisy formatting. In total 
we noted 52 different judges who collectively presided 
over these cases. The average size of the bench was 
3 while the maximum was 17-the full bench. The full 
bench was constituted in 10 instances which highlights 
the importance of these cases. A quick inspection of 
these cases revealed that they were indeed high profile. 
One of the cases dealt with the National Reconciliation 
Order (NRO), a controversial law enacted by President 
Pervez Musharraf to provide carpet amnesty to all politi- 
cians and bureaucrats accused of corruption and other 
unlawful activities. Similarly, another set of cases re- 
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S# | Article # | CategorY (Chapter) | # of Cases 
1. 184 (3) The Supreme Court 107 
2. 199 The High Courts 62 
3. 9 Fundamental Rights 60 
4. |4 Introductory 44 
5. 184 The Supreme Court 40 
6. |25 Fundamental Rights 38 
7. 3 Introductory 33 
8. 2A Introductory 29 
9. 14 Fundamental Rights 28 
10. | 9 Fundamental Rights 26 




















Table 4: List of the ten most cited Articles of the Consti- 
tution. 


volved around the 18th Amendment. The 18th Amend- 
ment was applied to the Constitution in 2010 and among 
many other changes, it revoked the power of the Presi- 
dent to dissolve the legislature, and did away with most 
of the changes introduced to the Constitution during the 
time of President Pervez Musharraf. Both of these cases 
are clearly in the interest of the wider public; thus il- 
lustrating that even the size of the bench can reflect the 
importance of a case. 

To work out the most prolific judges in the last one 
decade, we counted the number of times they presided 
over a case in the overall dataset. Some of the names 
were misspelt or abbreviated; thus underscoring the 
ubiquity of L2 and L3. Table [3| enumerates the ten 
most prolific judges. The Chief Justice, Justice Iftikhar 
Muhammad Chaudhry, who was deposed by President 
Pervez Musharraf, is by far the prolific judge by having 
presided over almost half of all cases. 


5.3 Most cited Articles of the Constitution 


The Articles of the Constitution which are referenced in 
a judgement/order can also be used as an indicator of the 
general scope of the case. For instance, if any judgement 
refers to Article 6, which deals with treason, it might in- 
dicate that the case revolves around treason. We again 
used a series of regular expressions to extract this in- 
formation. In total, 822 Articles and Sub-articles of the 
Constitution are referenced in these judgements/orders. 
The ten most cited Articles are listed in Table Arti- 
cle 184 (3), which gives the Court its Suo Moto pow- 
ers, is referenced in a fourth of all judgements. Articles 
that deal with fundamental rights of citizens are perva- 
sive in the most cited list. In addition, two of the refer- 
enced Articles from the Introductory Chapter in the table, 
in essence, also attend to fundamental rights. Specifi- 
cally, Article 3 enunciates the “elimination of exploita- 
tion” while Article 4 revolves around the “right of indi- 


viduals to be dealt with in accordance with law”. Overall 
the ubiquity of these Articles in the judgements suggests 
that the Court predominantly dealt with issues related to 
the fundamental rights of the citizens. This in part might 
be due to its application of judicial activism. 


5.4 Most cited Precedents/Cases 


Under the rules of the Common Law, rulings are based 
on legal precedents rather than any actual laws (in con- 
trast to Statuary Law) [I2]. Therefore, the set of previous 
cases that a judgement cites—in essence, its legal lineage— 
can illustrate the general theme of the judgement. For 
instance, if any judgement in Pakistan references “Fed- 
eration of Pakistan and others vs. Moulvi Tamizuddin 
Khan”, it means that the judgement in some way revolves 
around the “Doctrine of State Necessity”. This case has 
been used since the 1950s to justify military rule in the 
country. Generally, previous judgements are referenced 
by citing the law journal in which they were subsequently 
published. The most comprehensive of these journals, 
which contains all judgements since independence for 
all courts, is Pakistan Law Decisions (PLD). The citation 
format is: PLD year-of-the-judgement abbreviation-of- 
the-judgement-court judgement-number. For instance, 
the above mentioned “Federation of Pakistan and oth- 
ers vs. Moulvi Tamizuddin Khan” case is cited as PLD 
1955 FC 240. Another important journal is Supreme 
Court Monthly Review (SCMR) which contains more re- 
cent cases heard in the Supreme Court. Its citation format 
is: year-of-the-judgement SCMR judgement-number. In 
addition to these two, a number of other journals also ex- 
ist but we omit their details and analysis because they are 
rarely cited in our dataset. To extract PLD and SCMR ci- 
tations, we constructed regular expressions to match their 
citation formats. Surprisingly, these simple expressions 
were extremely effective in combing the documents for 
the required information: L7 — Even if the data is un- 
structured and noisy, domain-specific filtering is very ef- 


fective. A total of 363 unique PLD references and 910 


SCMR references were obtained. Table [5]and Table [6] 
enumerate the 10 most cited PLD judgements and SCMR 
judgements, respectively. Most of these cases deal with 
constitutional matters such as the legality of martial law 
(PLD 1972 SC 139) and the scope of “public impor- 
tance” (1998 SCMR 793). In addition, some cases deal 
with corruption (2012 SCMR 773) and the importance of 
the Civil Service (2010 SCMR 1301). 


6 Conclusion and Future Work 


We presented an analysis of more than decade worth of 
open data from the Supreme Court of Pakistan. Our anal- 
ysis shows that post-restoration the judiciary in Pakistan 
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Commissioner 


S# | Article of Constitution | Description # of Cases 

l. PLD 2009 SC 879 Sindh High Court Bar Association | 7 
vs Federation of Pakistan 

2. | PLD 2011 SC 997 Watan Party vs Federation of Pak- | 7 
istan 

3. PLD 1972 SC 139 Asma Jilani vs The Government of | 6 
Punjab 

4. PLD 1996 SC 324 Al-Jehad Trust vs Federation of | 6 
Pakistan 

5. PLD 1988 SC 416 Benazir Bhutto vs Federation of | 5 
Pakistan 

6. PLD 1973 SC 236 Raunaq Ali vs Chief Settlement | 4 


7. | PLD 1979 SC 38 
8. | PLD 1983 SC 457 


9. PLD 1993 SC 210 
vices 
10. | PLD 2007 SC 578 











Zulfiqar Ali Bhutto vs The State 3 
Fauji Foundation vs 
Rehman 

KBCA vs Hashwani Sales and Ser- | 3 


Chief Justice of Pakistan vs Presi- | 3 
dent of Pakistan 


Shamimur | 3 











Table 5: List of the ten most cited PLD judgements. 


has undertaken cases of wider public interest that primar- 
ily protect the fundamental rights of the citizens. In the 
process we highlighted several challenges that any prac- 
titioner who makes use of open data will face, including 
missing data, misspellings, and lack of term consistency. 
As this was an initial study, our future work is exten- 
sive. This paper only presented statistical analysis to un- 
derstand some of the inherent trends in the data. Our 
future work consists of using machine learning and data 
mining techniques to classify the documents. For in- 
stance, leveraging the underpinnings of common law, it 
would be interesting to train a learner to predict the out- 
come of a case based on its similarity with prior cases. 
Furthermore, some of the key concepts within the text 
can be understood better by linking in their semantic 
meaning. Therefore, we intend on using DBpedid| to 
inject such semantics into the text. For example, if a 
case mentions an individual or a company, ontological 
and descriptive information can be pulled in to discern 
the nuances of legal text. Finally, we hope to extend our 
analysis to a wider range of open data from the develop- 
ing world; not necessarily confined to the legal domain. 
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